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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments, see the amendment, filed 12/22/05, with respect to the 
rejection(s) of claim(s) 1-10, 12, 13, and 15-22 under 35 U.S.C. 102 and 103 have been fully 
considered and are persuasive. Therefore, the rejection has been withdrawn. However, upon 
further consideration, a new ground(s) of rejection is made in view of Rodriguez et al., US 
5,999,207. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1-4, 6-10, 12, 13,15 -19, 22, and 23 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Hiroaki, US 5,786,846, in view of Rodriguez et al., US 5,999,207. 

In regard to claims 1 and 10, Hiroaki, US 5,786,846, discloses a method for 
indicating a location of a user of a two-way communication device within a video 
capturing volume of a camera operably coupled to the two-way communication device 
(see column 3, lines 20-26), the method comprising the steps of: 

receiving a first image from the camera (column 3, lines 27-29); 
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receiving a second image from a remote device (see column 10, lines 16- 

22); 

determining a location of the person within the video capturing volume of 
the camera based on the first image (see column 3, lines 34-36); 

generating an abstract representation of the person (see column 1 1, lines 1- 
15: An abstract representation of the person in the form of the local user's video 
or a picture an message is generated as a notification video); and 

displaying the abstract representation wherein the displayed position of the 
abstract representation indicates the location of the person within the video 
capturing volume of the camera (see column 10, lines 52-64). 
The Hiroaki reference does not disclose displaying the abstract representation 
overlaying the second image. The Hiroaki reference discloses that it is well known in the 
art to display the local user's on the screen with the together with the remote user's video 
(see figure 15 A-C and column 1, lines 28-40). The Hiroaki reference teaches that this is 
done to allow the local user to see video filmed from their site to confirm that he/she is 
located at an appropriate position in the shoot range of the camera. 

Rodriguez et al., US 5,999,207, discloses a video telephony system that receives a 
first image of a local user and a second image of a remote user and displays the abstract 
representation, the local user's image, overlaying the second image, the remote user's 
image (see figure 10 and column 6, lines 14-29). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Hiroaki, US 5,786,846, in view of Rodriguez 
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et al., US 5,999,207, to display the abstract representation overlaying the second image, 
in order to allow the local user to see video filmed from their site to confirm that he/she is 
located at an appropriate position in the shoot range of the camera. 

In regard to claims 2 and 3, Hiroaki, US 5,786,846, in view of Rodriguez et al., 
US 5,999,207, discloses the method of claim 1. The Hiroaki reference discloses wherein 
the step of determining a location of the person comprises the step of determining 
locations of the person's head and other portions of the person (see column 8, lines 53- 
56). 

In regard to claim 4, Hiroaki, US 5,786,846, in view of Rodriguez et al, US 
5,999,207, discloses the method of claim 3. The Rodriguez reference discloses wherein 
the step of generating an abstract representation of the person comprises the step of 
generating a plurality of abstract representations, each of the plurality of abstract 
representations corresponding to a respective portion of the person, and wherein the step 
of displaying the abstract representation comprises the step of displaying the plurality of 
abstract representations such that the plurality abstract representations indicate the 
plurality of locations of the respective portions of the person within the video capturing 
volume of the camera (see figure 10). 

The abstract representations of each portion of the user are in the image filmed 
on the user side and when displayed as the local user video, each portion of the user is 
shown in its location with respect to the camera. 

In regard to claim 6, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the method of claim 1. The Rodriguez reference discloses wherein 
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the step of displaying the abstract representation comprises the step of animating the 
abstract representation over a plurality of video frames (see column 6, lines 14-26: The 
video is shown as an animated or motion picture.) 

In regard to claim 7, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the method of claim 1. The Hiroaki reference discloses wherein the 
step of determining a location of the person within the video capturing volume of the 
camera comprises the steps of: 

determining whether at least a portion of the person is represented in the 

first image (see column 3, lines 34-36); and 

in the event that at least a portion of the person is represented in the first 

image, determining that the person is within the video capturing volume of the 

camera (see column 3, lines 37-40). 

In regard to claim 8, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the method of claim 7. The Rodriguez reference discloses wherein 
the step of displaying the abstract representation comprises the step of displaying the 
abstract representation to the person such that the abstract representation indicates the 
location of the person within the video capturing volume of the camera (see se figure 10). 

In regard to claim 9, Hiroaki, US 5,786,846, in view of Rodriguez et al, US 
5,999,207, discloses the method of claim 7. The Hiroaki reference discloses wherein the 
step of displaying the abstract representation comprises the step of displaying the abstract 
representation to the person such that the abstract representation indicates that the person 



Application/Control Number: 09/773,863 Page 6 

Art Unit: 2615 

is outside the video capturing volume of the camera in the event that the at least a portion 
of the person is not represented in the at least one image (see column 11, lines 1-15). 

In regard to claim 12, Hiroaki, US 5,786,846, discloses an apparatus that is 
operably coupled to a camera (see figure 3), the apparatus comprising: 

a location determiner (see figure 3, element 101), operably coupled to the 
camera, for determining a location of the person within a video capturing volume 
of the camera based on a first image received from the camera, the first image 
including at least a portion of a person (see column 7, lines 1-15); 

an abstract representation generator (see figure 3, element 302) for 
generating an abstract representation of the person (see column 10, lines 57-60 
and column 11, lines 12-15: Using the local user image video serves as an 
abstract representations displaying the locate of the user with respect to the 
camera); 

a receiver (see figure 2, element 201) receiving a second image from a 
remote device (see column 10, lines 16-22); and 

a video processor (see figure 3, element 301), operably coupled to the 
location determiner and the abstract representation generator, for positioning the 
abstract representation in an image to be displayed to the person, wherein the 
position of the abstract representation indicates the location of the person within 
the video capturing volume of the camera (see column 10, lines 57-60: The video 
synthesis section displays the user's image or abstract representation on the screen 
to show the user that he/she is out of range.). 
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The Hiroaki reference does not disclose displaying the abstract representation 
overlaying the second image. The Hiroaki reference discloses that it is well known in the 
art to display the local user's on the screen with the together with the remote user's video 
(see figure 15 A-C and column 1, lines 28-40). The Hiroaki reference teaches that this is 
done to allow the local user to see video filmed from their site to confirm that he/she is 
located at an appropriate position in the shoot range of the camera. 

Rodriguez et al., US 5,999,207, discloses a video telephony system that receives a 
first image of a local user and a second image of a remote user and displays the abstract 
representation, the local user's image, overlaying the second image, the remote user's 
image (see figure 10 and column 6, lines 14-29). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Hiroaki, US 5,786,846, in view of Rodriguez 
et al., US 5,999,207, to display the abstract representation overlaying the second image, 
in order to allow the local user to see video filmed from their site to confirm that he/she is 
located at an appropriate position in the shoot range of the camera. 

In regard to claim 13, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the apparatus of claim 12. The Hiroaki reference further 
comprising: 

a display (see figure 3, display), operably coupled to the video processor, 
for displaying the image containing the abstract representation to the person (see 
column 10, lines 57-60). 
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In regard to claim 15, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the apparatus of claim 12. It is implied in the Hiroaki reference that 
a transmitter receives/transmits the video signal from the remote user in order to display 
it on the screen for the local user to see (see column 6, lines 50-63). 

In regard to claim 16, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the apparatus of claim 12. The Hiroaki reference discloses wherein 
the location is an actual location of the person in the video capturing volume of the 
camera during a video frame processed by the camera (see column 1 1, lines 13-16: the 
video is in real time). 

In regard to claim 17, Hiroaki, US 5,786,846, in view of Rodriguez et al, US 
5,999,207, discloses the apparatus of claim 12, The Hiroaki reference discloses wherein 
the location is a relative location change within a plurality of video frames processed by 
the camera (see column 1 1, lines 13-16: The user image displayed is a continuous video 
or semi-motion video (see column 6, lines 42-43), so any change in the users position 
will be viewed over several frames.). 

In regard to claim 18, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the apparatus of claim 17. The Hiroaki reference discloses wherein 
the relative location change comprises at least one of a translation and a rotation (see 
column 11, lines 13-16: When the user is notified they are out of position by displaying 
the video, their translation from the out of range position to the in range position is also 
displayed.). 
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In regard to claim 19, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the apparatus of claim 12. The Hiroaki reference discloses wherein 
the location comprises at least one of a position and a depth (see column 1 1, lines 13-16: 
The user video depicts the user position and/or depth by the location and size of the user 
in the image on the display.). 

In regard to claim 22, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses the apparatus of claim 12. The Hiroaki reference discloses wherein 
the abstract representation further indicates a direction in which the person should move 
in order to be located substantially in a center portion of the video capturing volume of 
the camera (see column 1 1, lines 3-5 and 13-16: By seeing his/her image on the screen 
off-centered, the user will intuitively know which direct to move in order to be centered 
in the picture). 

In regard to claim 23, Hiroaki, US 5,786,846, discloses a two-way communication 
device (see figure 6) comprising: 

a camera (see figure 6, element 602) for capturing an image within a video 
capturing volume of the camera to produce a captured image, the captured image 
including at least a portion of a user of the two-way communication device (see 
column 11, lines 13-16); 

a location determiner (see figure 6, element 101), operably coupled to the 
camera, for determining a location of the person with respect to a video capturing 
volume of the camera based on at least one image received from the camera, the 
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at least one image including at least a portion of a person (see column 7, lines 1- 
15); 

an abstract representation generator (see figure 4, element 302) for 
generating an abstract representation of the person (see column 10, lines 57-60 
and column 1 1, lines 12-15: Using the local users image video serves as an 
abstract representations displaying the locate of the user with respect to the 
camera); and 

a receiver (see figure 6, element 601) for receiving an image from a 
second two-way communication device (see column 6, lines 50-63); 

a video processor (see figure 4, element 301), operably coupled to the 
location determiner and the abstract representation generator, for arranging the 
abstract representation and the image received from the second two-way 
communication device together in a composite image to be displayed to the user, 
wherein the position of the abstract representation indicates the location of the 
person within the video capturing volume of the camera (see column 12, lines 4- 
30: The video synthesis section displays the both video images, user's image or 
abstract representation and the second user's video image, in secession or at the 
same time on the screen to show the user that he/she is out of range). 

a display (see figure 6, element 603), operably coupled to the video 
processor, for displaying the composite image to the user; and 
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a transmitter (see figure 6, element 601), operably coupled to the camera, 
for communicating the captured image to the second two-way communication 
device (see column 6, lines 50-54). 

The Hiroaki reference does not disclose displaying the abstract representation 
overlaying the second image. The Hiroaki reference discloses that it is well known in the 
art to display the local user's on the screen with the together with the remote user's video 
(see figure 15 A-C and column 1, lines 28-40). The Hiroaki reference teaches that this is 
done to allow the local user to see video filmed from their site to confirm that he/she is 
located at an appropriate position in the shoot range of the camera. 

Rodriguez et al., US 5,999,207, discloses a video telephony system that receives a 
first image of a local user and a second image of a remote user and displays the abstract 
representation, the local user's image, overlaying the second image, the remote user's 
image (see figure 10 and column 6, lines 14-29). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Hiroaki, US 5,786,846, in view of Rodriguez 
et al., US 5,999,207, to display the abstract representation overlaying the second image, 
in order to allow the local user to see video filmed from their site to confirm that he/she is 
located at an appropriate position in the shoot range of the camera. 
4. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hiroaki, US 
5,786,846, in view of Rodriguez et al., US 5,999,207, as applied to claim 1 above, and 
further in view of Wilensky, US 2002/0118875. 
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In regard to claim 5, Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, discloses a method of claim 1. The Hiroaki and Rodriguez references do not 
disclose comprising the steps: 

determining a location of at least one of another person and an object; 
generating a corresponding abstract representation of the at least one of 

another person and an object to produce a second abstract representation; and 
displaying the second abstract representation to the person such that the 

second abstract representation indicates the location of the at least one of another 

person and an object within the video capturing volume of the camera. 

Wilensky, US 2002/01 18875 discloses a method and apparatus for extracting an 
object in the foreground of an image from the background of the image (see paragraph 
33). The user can define multiple objects to be extracted, if the image contains multiple 
objects (see paragraph 36 and figures 1 and 6). Once the objects have been selected, the 
extraction process selects each object one at a time and generates three masks for each 
object (see paragraphs 42 and 55 and figure 5, steps 520-535), Finally, the images are 
assembled showing the objects against a new background (see paragraph 55). In an 
alternative implementation of the invention, one or more objects can be tracked 
automatically throughout a video sequence by selecting the objects in one initial 
keyframe (see paragraph 62). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Hiroaki, US 5,786,846, in view of Rodriguez 
et al., US 5,999,207, and further in view of Wilensky, US 2002/01 18875, to have the 
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location detection section detect multiple objects positions and perform the steps of claim 
5, in order to track the location of multiple objects throughout the video sequence. 
5. Claims 20 and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hiroaki, US 5,786,846, in view of Rodriguez et al., US 5,999,207, as applied to claim 12 
above, and further in view of Hindus et al., US 6,282,206. 

In regard claim 20 and 21, Hiroaki, US 5,786,846, in view of Rodriguez et al, US 
5,999,207, discloses the apparatus of claim 12. The Hiroaki and Rodriguez references do 
not disclose that the abstract representation comprises an icon or a geometric. 

Hindus et al., US 6,282,206, discloses a two-way video communication system 
that produces low bandwidth output in the form of cartooned video or reduced resolution 
video (see column 10, lines 15-20). The image captured on the local users side is passed 
through a dynamic abstraction filter to create a representational image or icon wherein 
the head and eyes of the person are in the shape of geometric circles (see figure 1, 
element 44 and column 10, lines 20-25). The reference teaches the representational 
image takes relatively few bits per second to transmit any dynamic updates to the image 
from the first communication station (see column 10, lines 25-29). 

It would have been obvious to one skilled in the art at the time of invention to 
have been motivated to modify Hiroaki, US 5,786,846, in view of Rodriguez et al., US 
5,999,207, and further in view of Hindus et al, US 6,282,206, to have a dynamic 
abstraction filter that produces cartooned icons of video images as geometric shapes in 
order to lower the bandwidth of the video data as taught by Hindus. 
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Conclusion 

6. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gevell Selby whose telephone number is 571-272-7369. The 
examiner can normally be reached on 8:00 A.M. - 5:30 PM (every other Friday off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on 571-272-7593. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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DAVID OMETZ 
SUPERVISORY PATENT EXAMINER 



